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Spectral and formal stability criteria of spatially inhomogeneous stationary solutions to the Vlasov 

equation for the Hamiltonian mean-field model 
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Abstract 

Stability of spatially inhomogeneous solutions to the Vlasov equation is investigated for the Hamiltonian mean-field model to provide the 
spectral stability criterion and the formal stability criterion in the form of necessary and sufficient conditions. These criteria determine stability 
of spatially inhomogeneous solutions whose stability has not been decided correctly by using a less refined formal stability criterion. It is shown 
that some of such solutions can be found in a family of stationary solutions to the Vlasov equation, which is parametrized with macroscopic 
quantities and has a two-phase coexistence region in the parameter space. 
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I. INTRODUCTION 

The macroscopic behavior of many-body systems depends 
on whether the interaction is of long-range or short-range. For 
many-body systems with short-range interaction, the thermo- 
dynamic observables such as entropy and magnetization are 
additive and extensive but not so for those with long-range in- 
teraction. The additivity and the extensivity of observables are 
assumed to hold in the equilibrium statistical mechanics and 
thermodynamics. Macroscopic behaviors of many-body sys- 
tems with long-range interaction are quite different from those 
with short-range one OJ-Q]. The long-range interaction sys- 
tem is likely to be trapped in quasi-stationary states (QSSs), 
and accordingly a very long time is needed to reach the ther- 
mal equilibrium state. The duration of those QSSs increases 
according to the system size, and diverges if one takes the 
thermodynamic limit f5l- [TTll . It is a widely accepted under- 
standing that the equilibration is brought about by the finite 
size effect. 

A way to analyze a Hamiltonian system with long-range in- 
teraction is to use the Vlasov equation or collisionless Boltz- 
mann equation [HI], which can be derived by ta king th e 
limit of * co, where N is the number of elements Ill3l - [l5ll . 
The QSSs are supposed to be associated with stable station- 
ary solutions to the Vlasov equation (0, Etl • Finding a stability 
criterion for stationary solutions to the Vlasov equation is the 
first step to investigate QSSs, since such a criterion makes it 
possible to decide whether a stationary solution can be a QSS 
or not. 

The stability of solutions to the Vlasov equation has been 
investigated in ll6ll7t fT6l - l22ll . There are several concepts of sta- 
bility such as the spectral stability, the linear stability, the for- 
mal stability, and the nonlinear stability iflrjtl . The interest of 
this paper centers on the spectral stability and the formal sta- 
bility, but the linear stabilityand the nonlinear sta bility are not 
touched upon. The formal StM] and spectral lfl7ll20[|2Tll sta- 
bility criteria for spatially homogeneous solutions have been 
well known already. In contrast with this, for spatially in- 
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homogeneous solutions, a few studies have been performed, 
say, by Campa and Chavanis l22tl . They set up criteria for 
formal stability both in the most refined form and in less re- 
fined forms. Their formal stability criterion in the most refined 
form requires one to take into account an infinite number of 
Casimir invariants and to detect an infinite number of associ- 
ated Lagrangian multipliers in order to determine the stability 
of spatially inhomogeneous stationary solutions. Their formal 
stability criterion is hence hard to use. In contrast with this, 
the canonical formal stability criterion which is one of the less 
refined formal stability criteria is of practical use. Using the 
canonical formal stability criterion, one can check stability of 
a stationary state against a perturbation which keeps the nor- 
malization condition but may break the energy conservation 
and other Casimir invariant conditions. Though the criterion 
for canonical formal stability is stated as a necessary and suf- 
ficient condition, it is just a sufficient condition for the formal 
stability. It is to be expected that a criterion for the formal 
stability is found out in the form of necessary and sufficient 
condition without reference to an infinite number of quanti- 
ties such as Lagrangian multipliers. 

This article deals with the Hamiltonian mean-field (HMF) 
model f23l l24ll with the anticipation stated above. The HMF 
model is a simple toy model which shows typical long-range 
features. For instance, the HMF model has been used for in- 
vestigating the nonequiUbrium phase transitions lt25t - l28ll . the 
core-halo structure Il29ll . the creation of small traveUng clus- 
ters ll30tl . the construction of traveling clusters [31 L and a re- 
laxation process with long-range interactions @ 0]. More- 
over, the HMF model allows one to perform theoretical study 
on dynamics near spatially inhomogeneous stationary solu- 
tions to the Vlasov equation by the use of the dispersion func- 
tion which can be explicitly written out for the HMF model. 
For instance, the dynamics of a perturbation around the spa- 
tially inhomogeneous stationary solution ll32tl and the alge- 
braic damping to a QSS l33ll have been investigated theoret- 
ically and numerically by using the HMF model. Further, 
the linear response to the external field is studied in an ex- 
plicit form ||34|| for a spatially inhomogeneous QSS. In those 
studies, the stability of the spatially inhomogeneous solutions 
have been assumed to hold, and then it is worthwhile to give 
an explicit form of necessary and sufficient condition for the 



1 



stability of the spatially inhomogeneous stationary solutions. 
The aim of this article is to find spectral and formal stabil- 
ity criteria for spatially inhomogeneous stationary solutions. 
The spectral stability criterion is derived by means of the dis- 
persion relation. The formal stability criterion is obtained by 
using the same idea as exhibited in [22] . The criterion we are 
to find by using the angle-action variables is free from an in- 
finite number of Lagrangian multipliers, and is stated in the 
form of a necessary and sufficient condition, which allows us 
to look into the stability of spatially inhomogeneous solutions 
in an accessible manner. 

This article is organized as follows. Section UT1 contains a 
brief review of the two kinds of stabilities of a fixed point 
of a dynamical system. The nonlinear and linearized Vlasov 
equations for the HMF model are introduced in Sec. [HI] The 
spectral stability criterion for spatially homogeneous solutions 
to the Vlasov equation is given in Sec. [IV] in a rather simple 
method than that already known. By using the same method, 
the spectral stability criterion for spatially inhomogeneous so- 
lutions is obtained in Sec. IV Bl The formal stability criterion 
for spatially inhomogeneous solutions is derived in Sec. IV Dl 
Section[VT]gives an example which shows that the present sta- 
bility criterion is of great use. It is shown that there is a family 
of stationary solutions whose stability cannot be judged cor- 
rectly by using the canonical formal stability criterion but can 
be done by the criterion given in this article. Section IVTTI is 
devoted to a summary and a discussion for generalization. 



H. SPECTRAL STABILITY AND FORMAL STABILITY 

We start with a brief review of definitions of spectral stabil- 
ity and formal stability, following Holm et al. lfl6fl . Let X be 
a normed space. Suppose that a dynamical system is given by 
the equation, 



dx 

Tt 



= f{x), XtX. 



(1) 



Let x„ be a fixed point of this system, f(x*) = 0. Then, the 
linearized equation around x* is expressed as 



f t = Df( X ,m, 



(2) 



where Df(x*) is a linear operator derived from / at x„. The 
spectral stability and the formal stability of the fixed point x t 
are defined as follows: 



(or positive) definite. The fixed point x» is said to be 
neutrally formally stable if the second variation of T at 
x t is negative (resp. positive) semi-definite but not neg- 
ative (resp. positive) definite. Further, the fixed point i, 
said to be formally unstable if the second variation of T 
at jc, is not negative (or positive) semi-definite. 

If the dynamical system in question is infinite dimensional, the 
fixed point x„ is occasionally called a stationary state. We note 
that the definition of neutral spectral stability is different from 
the original one in |[l6ll . The detail of our footing for stability 
analysis is exhibited in Appendix lAl According to |[l6tl . the 
neutrally spectrally stable solution is spectrally stable, but the 
neutrally formally stable solution is not formally stable. 



III. VLASOV EQUATION FOR HAMILTONIAN MEAN- 
FIELD MODEL 



The Hamiltonian mean-field (HMF) model 1231 |24tl for N 
unit mass particles on the unit circle S 1 has the Hamiltonian 
given by 



N p 2 1 N 

^ = Zy + SvZ( 1 - C0S ^-^' ) )' (3) 

pi e R, q t e [-tt, tt), i = 1, 2, ■ ■ ■ N. 

In the limit of N tending to infinity, the time evolution of the 
HMF model can be described in terms of a single-body dis- 
tribution / on the //-space which coincides with S 1 x R. The 
single-body distribution / is known to evolve according to the 
Vlasov equation, 



%+mf],f\=o, 

ot 

where < H\f\ is the single-body Hamiltonian defined to be 

< H\S\ = ^ +<V[f\{q,t), 

dq'cos(q-q') f(q',p',t)dp', 

K J — CO 

p G R, q e [-tt,tt), 
and where {a, b) is the Poisson bracket given by 



(4) 



(5) 



The fixed point jc, is said to be spectrally stable, if the 
linear operator Df(x t ) has no spectrum with positive 
real part. In addition, if the linear operator Df(x„) has 
an eigenvalue with vanishing real part, x t is called neu- 
trally spectrally stable. The fixed point x„ is said to be 
spectrally unstable when there exists a spectrum with 
positive real part. 

The fixed point jc» is said to be formally stable, if a con- 
served functional f[x] takes a critical value at x — x* 
and further the second variation of T at jc« is negative 



^ ^ da db da db 
dp dq dq dp 



(6) 



By averaging the distribution / in the x- and y-directions, the 
order parameter M[f] = \ M x [f\, M y [f]j is defined to be 



SL 



M x [f](f)= cosqf(q,p,t)dqdp, 



-SL' 



(7) 



M y [f](t) = | J sin q f(q, p, t) dqdp, 
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where the symbol yu denotes the whole yu-space, S 1 X R. In the 
Vlasov dynamics, a functional 



■JDC 



Q (f(q, P, 0) dqdp 



(8) 



is conserved for any function Q, and such a functional is called 
a Casimir invariant. 

Let fo denote a stationary solution to the Vlasov equation. 
Then a small perturbation f\ around fo is shown to obey, in 
some timescale, the linearized Vlasov equation 



9fl -If 

£fi :=-W[folfi}-{ f V[filM. 



(9) 



This equation can be analyzed by means of the Fourier- 
Laplace transformation. For the sake of physical interpreta- 
tion, we define the Laplace transform of a function g(t) to be 



£0) 



f 

Jo 



g(t)e ,0J 'dt, Imw > 0. 



(10) 



Through the Fourier series expansion with respect to q and the 
Laplace transformation with respect to t, Eq. (|9]l is brought 
into the dispersion relation D(cS) = lfl2i l35ll . The explicit 
form of the dispersion relations for spatially homogeneous 
stationary states and for spatially inhomogeneous stationary 
states will be exhibited in Sec. |lV]and in Sec. |VJ respectively. 
We call D{(jS) a dispersion function, which is said to be a di- 
electric function in the context of the plasmas physics. A root 
at of this dispersion relation with positive imaginary part is in 
one-to-one correspondence with the eigenvalue -ia> of the lin- 
ear operator X. The detail of this fact is reviewed in Appendix 
IbI It then follows that the stationary solution /o is spectrally 
unstable if the dispersion relation D((l>) - has a root in the 
upper half w-plane. 

Though the domain of the dispersion function D(a>) is 
the upper half w-plane, it can be analytically continued to 
the lower half w-plane lfl2l l35tl . The root of the disper- 
sion relation on the lower half plane causes the exponential 
damping of the order parameter for the small perturbation 

M[fi] - (M x [f\\,M y [fi\\ , which is called the Landau damp- 
ing lfl2[ l35H36ll . Such a root is not an eigenvalue, but is called 
a resonance pole, a Landau pole, or a fake eigenvalue. 

We remark on embedded eigenvalues of the linear operator 
X on the imaginary axis. The linear operator X may have con- 
tinuous spectra lying on the imaginary axis ll37ll . An "eigen- 
value" with zero real part is occasionally embedded in contin- 
uous spectra and such an "eigenvalue" is called an embedded 
eigenvalue. 

Let a stationary solution fo be spatially inhomogenous, i.e., 
|-^[/o]| + 0. Owing to the rotational symmetry of the HMF 

model, there must be a mode f? associated with the zero em- 
bedded eigenvalue of the linearized Vlasov operator. The di- 
rection of a perturbation M[jf] is perpendicular to the direc- 
tion of the order parameter M[fo]- This fact is consistent with 



the fact that the order parameter changes its direction, keep- 
ing its radius, in the presence of an infinitesimal external field 
which is perpendicular to the order parameter [1341 . When 
the nonequilibrium phase transition II25h28|1 is of interest, the 
phases are defined by the modulus of the order parameter, and 
hence the direction of the order parameter is not questioned. 
At present, we mainly focus on the stability against the per- 
turbation parallel to the order parameter M[fo\- 



IV. STABILITY CRITERION FOR SPATIALLY HOMOGE- 
NEOUS STATIONARY SOLUTION 



As long as the linear operator X defined in (0 is concerned, 
the spectral stability condition for a stationary solution fo to 
the Vlasov equation can be compactly stated; if there is no 
eigenvalue of X, the stationary solution fo is said to be spec- 
trally stable. Since the spectrum of X consist of eigenval- 
ues on C \ /R, continuous spectra on the imaginary axis, and 
the embedded eigenvalue on the imaginary axis II 3711 . only the 
eigenvalues are able to contribute to the spectral instability. 
On account of this fact, the spectral stability criterion is stated 
as follows: 



Proposition 1 Let fo(p) be a spatially homogeneous station- 
ary solution to the Vlasov equation, which is assumed to be 
smooth, even, and unimodal, and further the derivative f!Xp) 
of which is assumed to have the support R Then the station- 
ary solution fo is spectrally stable, if and only if fo satisfies 
the inequality 



I[fo] = 1 + 



'f 



fo(P) 



dp > 0. 



(11) 



We note that /q(p)/p has no singurality for all p e R on 
account of the assumption that fo is smooth and even. Though 
the inequali ty dTTb can be derived by using the Nyquist's 
method lfl7i |2C& l2lll . we introduce a method other than the 
Nyquist's method to prove this proposition. 

For a spatially homogeneous stationary solution fo(p), the 
dispersion relation D(u>) = with Imw > is put in the form 



D(co) = 1 + 



'f 



/oCp) 



dp = 0, Imw > 0. 



(12) 



The dispersion function is continued to a> = from the upper 
half w-plane, by taking the limit D(0) = lim e ^o+ D(ie). Not- 
ing that fi ) (p)/p has no singularity, we obtain D(Q) = I[fo], 
since the integrand in (fT2l has no singularity when a> — 0. We 
put weCin the form oj — a> r + with <±> x e R and <0\ > 0. 
When the dispersion relation (Q~2) is satisfied by some to with 
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Imw > 0, the imaginary part of D(co) is zero, so that one has 
MP) 



ImD(w) = noj\ 

— Ana) 
= 0. 



f 

r 

Jo 



(p — a> r )~ + ati 



Pfo(P) d P 



{(p - u r f + co\){(p + u r f + cJ) 

(13) 



Since fo(p) is an even unimodal function, pf$(p) < for all 
p > 0. The integral in dT3l l is to be negative value, and (foi l 
implies that <w r = 0, since cl>{ > 0. Conversely, if a> r = 0, the 
equality ImD(w) = holds true. The condition ai r — is then 
equivalent to the condition (fT3l . 

Now, on account of the fact pf \p) is negative for all p + 0, 
and the dispersion function satisfies the inequality 



D(itoi) = 1 + 



•J —a 



Pfoip) 
P 2 + rf 



dp > I[fo], 



(14) 



for all a); > 0, where the equality is satisfied if and only if 
cji = 0. This is because D(ia)i) becomes J[/o] for o»; = and 
because D(ia>i) is a continuous and strictly increasing function 
with respect to <x>i. It then follows that if D(a>) = with u> = 
iu>i, or equivalently, if £ has an eigenvalue -ico with Imw > 0, 
then I[fo] < 0. Conversely, if the inequality I[fo] < is 
satisfied, there exists a positive to\ such that D(ia>\) = 0. In 
fact, D(iu>i) is strictly increasing in cj\ with D(Q) = I[fo] and 
D(ici>i) — > 1 as oji — > oo. This means that £, has an unstable 
eigenvalue if and only if I[fo] < 0. Thus we have proved the 
spectral stability criterion ([TTV 

In comparison with the spectral stability criterion (ITT1 . the 
formal stability criterion H is given by 



im > o. 



(15) 



This inequality means that fo is spectrally stable but not neu- 
trally spectrally stable. This is because if D(0) = I[fo] = 0, 
the linear operator £, has an embedded eigenvalue 0, and 
hence fo is neutrally spectrally stable. 



V. STABILITY CRITERIA FOR SPATIALLY INHOMOGE- 
NEOUS STATIONARY SOLUTION 

In this section, we will give necessary and sufficient con- 
ditions for the spectral stability and for the formal stability 
of spatially inhomogeneous stationary solutions to the Vlasov 
equation. 

A spectral stability criterion for spatially inhomogeneous 
solutions can be given in an explicit form by performing the 
same procedure as that adopted in the last section. 

Furthermore, the formal stability criterion can be worked 
out if all the Casimir invariants are taken into account. For 
spatially inhomogeneous stationary solutions, Campa and 
Chavanis l22ll have given the formal stability criterion. How- 
ever, no one has these criteria explicitly, since one needs to 



detect values of an infinite number of Lagrangian multipli- 
ers. We can avoid a puzzle to detect an infinite number of 
Lagrangian multipliers if we use the angle-action coordinates 
in stability analysis. 

We denote the single-body energy by 



&(q, p) = p 1 12- Mq cos q, 



(16) 



where on account of the rotational symmetry of the HMF 
model, the order parameter has been set Mq = (Mq, 0) with 



M 



= jj cos qf (q,p)dqdp. 



(17) 



A. Angle-action coordinates for HMF model 

Before analyzing the stability of spatially inhomogeneous 
stationary solutions, we review the angle-action coordinates 
{8, J) for the HMF model. The detail of constructing the 
angle-action coordinates can be found in i32ll . 

To construct a bijective mapping of (q, p) to (8, J), we di- 
vide the p-space into three regions, U\ , U2, and t/3, which are 
defined, respectively, as 



Ui ={(q,p)\&(q,p)>M Q ,p>0}, 

U 2 = {(q,p)\\S(q,p)\<Mo}, 

U 3 = {(q,p)\8(q,p)>Mo,p<0}. 



(18) 



According to this division of the /i-space, we prepare the sets 
Vi , V2, and V3 defined to be 



Vi = {(0j I Qi e [-jt, tt), Ji > 4 VMq/ttJ , 

V 2 = {(02, h) I 02 e [-n,n),0< J 2 < 8 VMo/tt}, (19) 

V 3 = ((0 3 , /3) I 03 e [-n, n), J 3 > 4 VMoVtt} , 

respectively. Then, the maps (q,p) t-» (0i,J,) : U\ — > V;, for 
i = 1,2,3, are bijective. Since we are interested in integra- 
tion over the /i-space, we do not have to mention more on the 
boundaries of U;. 

According to these bijections, a function g whose argu- 
ments are the angle-action variables (0, J) is denoted by 



8(0, J) = 



gi(8uh), (0,J)&Vi, 
82(02, J2), (0,J)eV 2 , 
[83(03, J3), (P,J)eV 3 , 



(20) 



respectively. We will omit the subscript i if no confusion 
arises. For notational simplicity, we denote the integral of the 
function (|20| | over the whole yu-space by the left-hand side of 
the following equation 

jj^g(0,J)d0dJ = ^giOiJddOidJt. (21) 
In a similar manner, the integration of a function f(J) is put 
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in the form, 



f f(J)dJ= f MJi)dJ! 



Jr*8 ^Mq/k poo 
f 2 (J 2 )dJ 2 + 
J 4 VMo/t 



MJj)dJ 3 . 



Before proving Prop. [2] we note that the monotonicity of fo 
in J is satisfied for stationary solutions which are obtained as 
solutions to an optimization problem such as the maximiza- 
tion of the entropy or the minimization of the free energy 
( 22 ) JH. We note also that f^(J)/D.(J) is finite for all / since 
dfo (<5) /dS has no singularity. 



In the later part of this article, the monotonicity of a function 
f(J) with respect to / means the monotonicity of functions 
fi(Ji) with respect to /, for each i = 1, 2, 3, respectively. 



B. Spectral stability criterion 

We derive a necessary and sufficient condition for a spa- 
tially inhomogeneous stationary solution fit to the Vlasov 
equation to be spectrally stable, which is stated as follows: 



Proposition 2 Let fo be a spatially inhomogeneous stationary 
solution to the Vlasov equation, which is assumed to depend 
on the action J only through the single-body energy S( J) in 
such a manner that 



f (q, p) = f (J{q, p)) = fo (&{q, p)) ■ 



(23) 



Further, fo (J) and fo (£) are assumed to be strictly decreasing 
with respect to J and &, respectively. A further assumption 
is that dfo (S) /d& is continuous with respect to £>. Such a 
stationary solution fo(q,p) is spectrally stable, if and only if 



dq cos 2 q -—^(q,p)dp 

n J-co P dp 

2 * fl^lcV)l 2 ^>o, 



(24) 



where (9, J) are the angle-action coordinates and £2(7) = 
dS(J)/dJ, and where C"(J) is defined by 



cos q{0, J)e- >nB dO, n e Z. (25) 



J 



The proof of Prop. [2] can be performed in a similar man- 
ner to that applied to Prop. Q] though the fo is spatially in- 
homogeneous in the present proof. We divide the stability 
analysis into two, one of which deals with stability against the 
perturbation in the direction parallel to the order parameter 
Mo — (Mo, Q) T and the other with stability against the pertur- 
bation in the direction perpendicular to Mo- 

We first analyze the stability against the perturbation in the 
direction parallel to the order parameter Mo = (Mo, 0) r . The 
dispersion function in this case is put in the form 



D x (cS) = l+ 2n 



mf'(J) 



° v ' \nm, rvl2 



m£l(J) - U) 



C"\J)\ A dJ, Imw > 0, 



(26) 

and the dispersion relation is given by D x (oj) — [32]. When 
Imw > 0, the term of m = in (|26| | vanishes and Eq. ( l26l > is 
arranged as 



D x (u) = l+2n 



fo(J) 



Tj f 7T~7r ]-\C m (J)\ 2 dJ, lmw>0. 

(27) 

We here note that D x (0) is defined as D X (Q) = lim e ^o+ D x (ie), 
and 



D X (Q) =l+2n 



m#0 ^ L 



Q(J) 



C\J)\ 2 dJ, (28) 



since the integrand in it has no singularity. 

If there exists to such that D x (a>) = with Imw > 0, then 
one has lmD x (a>) = 0, which is written out as 



lmD x (aj) = ^ — cji f 

meZ\{0J M 



v 8;r r 

hi m Jl 



|C"'(7)| 2 Q(7)/;;(7) 
(Q(7)-w r /m) 2 + (wi/m) 2 

\C m (J)\ 2 Q.(J)f -(J) 



dJ 



(Q(7) - ajjm) 2 + (Wi/m) 2 

\C m (J)\ 2 Q.(J)f'(J) 



J T 2n r \c-»{j)\ z n(J)fo(J) J7 

dJ a>i I -dJ 

m J L (Q(7) + cojm) 2 + (w;/m) 2 



{(Q(7) - w r /m) 2 + (wi/m) 2 } [(C1(J) + cj r /m) 2 + (wi/m) 2 
I 



dJ = 0, 



(29) 



where we have used the fact C\J) = C m (J)* which is de- O(Z) > and f^iJ) < for all J, the integrals in (1291 give 
rived from (l25l l. Since \C"'(J)\ 2 > for some m e N, and negative values. Then d29l yields a> r = 0, since w; > 0. We 
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thus have shown that if a> = a> r + ia>\ with co\ > is a root of 
D x (io) = then co r = 0. 



On account of w r = 0, the dispersion relation reduces to 



D x (m) = l+4nY —±^±—\C m (J)\ 2 dJ 



(30) 



0. 



The function D x (iwi) is a strictly increasing continuous func- 
tion of a>i, and converges to 1, D x {ico\) — > 1, as u>\ — > oo. This 
implies that if D A (0) < 0, there is a positive number a), > 
such that D x (ia>i) = 0. Put another way, if D x (0) < 0, there 
is an ai such that D x {cl>) = 0, Imoi > 0. The converse is also 
shown by taking the contraposition of that there is no root to 
of D(oj) with Imw > if O. t (0) > 0. We hence conclude that 
there is no unstable eigenvalue for the perturbation whose di- 
rection is parallel to the order parameter Mo = (Mo, Q) T , if and 
only if D x (0) > 0. If 0,(0) = 0, the operator £ has an embed- 
ded eigenvalue 0, so that /o is neutrally spectrally stable. 



To derive the spectral stability criterion (l24l . we have only 
to prove the relation, 0,(0) = I[fo], which can be done by 
performing the same procedure as that carried out in Appendix 
C of 113411 . According to Appendix B of J32ll . the function cos q 
is expressed as 



cos q (9, J(k)) = 



1 - 2sn 



\ 71 



k<l, 



(31) 



where K(k) is the complete elliptic integral of the first kind 
ll38tl . and where k is defined as 



k = 



G(J) + M 



2M Q 



(32) 



Owing to the periodicity of the Jacobian elliptic functions 
ll3~8ll . the function cos q(9, J) is 27r-periodic with respect to 9. 
Then, from Parseval's equality, we obtain 

27r^|C'"(y)| 2 = I cos 2 ^(6i,y)c/6i-27r|C (7)| 2 - (33) 

By using this equation, we rewrite the second terms in the 
right-hand side of (f28) as 

r f'(J) r 71 r f'U) 

i dJ m J , cos2 q{G ' J) de ~ 271 i |cV)|2 dJ - 

(34) 

Keeping in mind the fact that the stationary solution fo to 
the Vlasov equation depends on the action J only through a 



single-body energy S, we arrange the first term of (l34t as 

r f'(J) c 

= [ dJ f — (£(/)) cos 2 q(9, J) d9 
J L J-„ dS 

= jj ^(6(/)) cos 2 q(9,J) d9dJ 



(35) 



-SL 



P dp 



(q,p) cos" q dqdp. 



In the course of analysis, we have used the fact that the trans- 
formation (9, J) i-> (q, p) is canonical. We note that dfu/dS is 
assumed to be continuous in J, and hence the integration with 
respect to J is taken along on the real /-axis. Then, by using 
(l2"TT i and (l22l . the second equality in (l35l l is derived. Equa- 
tions (l28l i. ( f34t . and (l35l l are put together to show the relation 
0,(0) = J[/o]. 

So far we have investigated the stability against perturba- 
tions in the direction parallel to the order parameter Mo = 
(Mo, 0) T . We proceed to look into the stability against a per- 
turbation in the direction perpendicular to the order parameter 
Mo- The dispersion relation corresponding to the direction 
perpendicular to the order parameter Mq is expressed as 



D y (a>) = 1 + 2tt V — \S m (J)\ 2 dJ = 0, (36) 

for Ima< > 0, where 

S"'(J)s— f smq(9,J)e- i "' e d9. (37) 
We note that S°(J) = 0. In fact, sin q(9, J) is expressed as 

k< 1, 



sin q (9, J(k)) = 



^0,k) d n[^k 



2sn|^Icn(^ 

7T K / \ 7T 



k>l, 
(38) 



it is odd with respect to 9 for all J fl38ll . so that one has 5' (7) = 
0. 

Following the same procedure as that for proving the re- 
lation 0^(0) = I[fo] and taking into account the relation 
S°(J) = 0, we obtain 



D,(0) = 1 + 



J J 11 P dp 



p) sin q dqdp. 



(39) 



If O v (0) > 0, there is no eigenmode which brings about the 
instability in a direction perpendicular to the order parameter 
Mo. Actually, the equality, O v (0) = 0, is satisfied for any 
stationary solution subject to the assumptions in Prop. |2]with 
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( fTSI l. which is proved as follows 1122th 



Here we assume that the total momentum vanishes, i.e. 



JJ» P dp 



p) sin q dqdp 



= Jj ^?(£>(q,p)) sin 2 q dqdp 

= kfl^ (q ' p)skiqdqdp 



(40) 



(q,p)cosq dqdp 



Since Z) x (0) = J[/ ] and D y (0) = 0, we have obtained 
the spectral stability criterion (l24l for the spatially inhomo- 
geneous solutions to the Vlasov equation. 

It is to be remarked that any spectrally stable solution which 
are spatially inhomogeneous are neutrally spectrally stable, 
since there is an embedded eigenvalue which comes from 
D,(0) = 0. 

To compute D A (0) or the right-hand side of (l24t . we should 
express C°(J) in terms of known functions. On using the ex- 
plicit expression of Q(7) and C°( J) given respectively in Ap- 
pendix B of JH and Appendix C of B, D ,(0) is described 
explicitly as 



DM = 1 + 
4 



JJ A < P dp 



f K(k) 
Jo 



(p) cos 2 q dqdp 
2E(k) 



K(k) 



- 1 



fo(k) dk 



(41) 



K(l/k) 



2k 2 E(l/k) , 
' + 1 - 2k 2 



K(l/k) 



fo(k) dk, 



where f (k) = f (J(k)). 



C. Stationary states realized as solutions to an optimization 
problem 

Before looking into the formal stability, we introduce sta- 
tionary states realized as solutions to an optimization problem 
on the basis of, say, the principle of maximum entropy. We 
here denote the entropy functional by 



S[f] 



s(f(q,p)) dqdp, 



(42) 



where s is a convex and twice differentiable function defined 
for the non-negative real numbers. We here consider a state 
realized as a solution to the optimization problem: 



maximize S[f], 

normalization condition, 
subject to \ energy conservation, 

total momentum conservation. 



(43) 



P[f] = ffpf(q,p)dqdp = 0. 



(44) 



The normalization and the energy conservation are expressed, 
respectively, as 



N[f\ 



p) dqdp = 1, 



(45) 



mf] = ff Yf(q,p) dqdp - l - (M x [f] 2 + M y [f] 2 ) = U, 

(46) 

where U is a fixed value. A solution fo to the optimization 
problem d43l satisfies the variational equation 5T = 6(S - 
pU - aN) = 0, which is writen out as 



s'{MJ))=p&{J) + a. 



(47) 



Since s(x) is a convex differentiable function defined on x > 0, 
its derivative s'{x) is strictly decreasing on x > 0, and the 
inverse function (s') (y) exists and is strictly decreasing on 
the range of the function s' . We are then allowed to put the 
solution fo(J) to the optimization problem d43l in the form 



/o (/(£)) = (>') + • 



(48) 



We note that a solution ( |48] i to the optimization problem ( |43l 
is a stationary solution to the Vlasov equation. 



Remark. The Lagrangian multiplier ft is positive [ 22]. To see 
this, we assume that /3 were not positive, (i) When ji < 0, 
from ( l48l i, the function fo (J (£)) is strictly increasing with 
respect to S, so that the function fo (J) is strictly increasing 
with respect to J. (ii) When f3 = 0, fo(J) is a constant for the 
whole /. In these cases, the integral J L fa(J) dJ diverges, and 
hence fo(J) cannot be a probabilistic density function. Hence, 
parameter j3 must be positive. In the case j3 > 0, fo(J) can be 
a probabilistic density function. 



D. Formal stability criterion 

In this section, we look into the formal stability of the spa- 
tially inhomogeneous stationary solution fo. To start with, we 
note that C(J) = C" n (7). In fact, from sn(u,k) = -sn(-u,k) 
lf38ll and (l3TT l. one has that cos q(6, J) is even with respect to 6, 
so that C n (J) is shown to be real from the definition ( |25T l and 
C"(J) = C-"(J), and further |C"(7)| 2 = C"(J) 2 . 

We derive the formal stability criterion for spatially inho- 
mogeneous solutions on the basis of the following claim. 

Claim 3 A solution fo(J) to the optimization problem (1431 ) is 
formally stable, if and only if the second-order variation of 
the functional T — S — pU — aN is negative definite at 
fo under the constraint of the Casimir invariants. That is, 
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6 2< F [fo] [Sf, Sf] < for any non-zero variation Sf leaving tional 001 ) is arranged as 
invariant the functional of the form © up to first order for 
any function Q. 



To investigate the condition S 2< F [fo] [Sf, Sf] < 0, we start 
by putting the function y as 



y(J) = 



P 



m = djo (S(J)) (49) 



s"{fo(J)) WJ) d& 
Then the second-order variation of T is described as 

+P jj cosq(9,J)Sf(9,J)d9dJ 
+ P jj sin q(6, J) Sf{6, J) dOdJ 



(50) 



On account of the constraints of the Casimir invariants (|8) 
up to first order, the perturbation should satisfy the constraint 



Q[fo + Sf] - Q[fo] = jj& (fo(q, p)) Sf(q, p) dqdp 
= JdJ Q' (f (J)) j 6f(6,J)dO 



(51) 



= 0. 



Since Q is chosen arbitrarily, we can look on Q' (foiJ)} as a 
function of / (or £(/)) chosen arbitrarily. We are then allowed 
to restrict perturbations to those satisfying 



f 

J -n 



6f(6, J) de = o, v/. 



(52) 



We now divide the perturbation 6f(8, J) into even and odd 
parts with respect to 8, 



where 



Sf(8,J) = 5j(8,J) + S f(8,J), 



s Job, J) = \ (sM J) + sf(-e, J)) , 
toM J) = \ (she, J) - 6f(-e, /)) . 



(53) 



(54) 



cos q(8, J) 6 e f(8, J) d8dJ 



+ Hr&)^ (e '* /)2 d6dJ 



(55) 



jj sin q( 8, J) S f( 8, J) dddj 

= s 2 r [fo] [sj, 6j] + s 2 r [fo] [Sof, sj] , 

where we have used the fact that 

M x [d f] = 0, My [Sj] = 0, (56) 

which come from the fact that cos q(6, J) (resp. sin q{9, J)) 
is even (resp. odd) with respect to 9 on account of QTl ) (resp. 
OH). Equation ( 1531 ) means that S e f and 6 f are not coupled in 
d55Y As for the second term in the right-hand side of the last 
equality in (|55] l, we recall that spatially inhomogeneous sta- 
tionary solutions are already known to be neutrally formally 
stable against a perturbation 5 f whose direction is perpen- 
dicular to the direction of the order parameter Mo, as is shown 
in lf22tl . This fact is consistent with the fact that the order 
parameter may rotate if an arbitrarily small external field is 
turned on perpendicularly to the order parameter [f34l . We do 
not take into account this rotation as long as we treat a formal 
stability of the stationary solution fo, as we mentioned in Sec. 
IrTfl On account of 06*1 ). we are now left with the analysis of, 
5 2( F [fo] [s e f, 8 e f], the integrals in 051) for the even part 6 e f 

whose direction is parallel to the order parameter Mo- 
In what follows, we prove the proposition: 

Proposition 4 Let fo be a solution to the optimization prob- 
lem ( 143b . The inequality 



I[fo] = D x (0) > 
is equivalent to the condition 

s 2 r[f Q ] [sJ,6 e f]<o 



(57) 



(58) 



for any 6 e f + under the constraint d52t . Therefore, the 
inequality d57l ) is a necessary and sufficient condition for the 
formal stability of fo- 

In the situation stated so far, the second order variation (l50l ) 
is put in the form 



jj cos q(9, J)5j(9, J) d9dJ 



(59) 



When Sf in the functional 0O| is replaced by ([53]), the func- We first show that a non-zero 6 e f satisfying M x [s e f] 
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does not bring about the formal instability. Indeed, ((59) 
becomes 

s 2 r [fo] [sj, s J] = ^ ^J) 5 ^ 1)2 dm (60) 

and is negative since y{ J) < and /3 > 0, as was mentioned in 
Sec.lVCl 

We proceed to perform the stability analysis with the con- 
straint condition 

M x [dj] = jj cos q{6, J)5J(9, J) dOdJ = 1 . (61) 



We note that the value of M x |£ e /J can be chosen arbitrary, 
because this value changes only the scaling of (|59l l and does 
not change the sign of d59l ). We expand the perturbation 6 e f 
into the Fourier series in 9, 

S e f(e,J) = Y J f:(J)e inB , f e n (J)=fc n {J). (62) 

ntO 

We note that the 0-th Fourier mode vanishes thanks to the con- 
straint condition (|52| l. Substituting (|62| i into (|59l l, we obtain 
the functional in /jf 



= Z f -jrMjfdJ + 2np V f C"(J')fl(J')dJ' 
We look for a critical point of ^ e under the constraint (|6T1 > which is rewritten in terms of ^ as 

lc\ <J L 



(63) 



(64) 



m*0 ' 



The functional ^ e takes a critical value under the constraint condition (l64l if 

^e[{^} m J-^,M4{^U=0, „ 6 Z\{0}, 
where 77 is a Lagrangian multiplier, and 5„@ t is defined by 



(./) 



m#0 



yG/) 



2J[ 



dJ, 



where §„„, is the Kronecker delta. Hence, Eq. d65l ) results in 



C"(J)y{J) + ^-C"(J)y(J) = -^C"(y) 7 (7), 



(65) 



(66) 



for all n e Z \ {0}, where we have used (l64l and put ^e1- zr^//?. Substituting d67l i into (1641) . we obtain the value of £ as 

-1 



2n Yj f cm 

m#0 ^ L 



(67) 



(68) 



A non-vanishing critical point {^' m } eZ ^ 0) is therefore given by 



C n {J)y{J) 



2nJ]f C"\f 



n eZ \ {0}. 



(69) 



) 2 r(/) rf/ 
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Substituting (|69l l into d63l l. we obtain 



A 1 



/8 



4tt' 



2 f c"V) 2 y(J)dJ 2n 

m*0 ^ L 



k 2 ^ f c"V) 2 r(J 

m*0 ^ L 



1 +2tt 



El 



^-C'(J) 2 dJ 



(70) 



where we have used d49l i. 



Since y{J) < 0, and since C"(J) + for some J and n e 
Z \ {0}, we have 



C m (jfy(J) dJ < 0. 



(71) 



It then follows, from dTOl i along with (fTTT i and the positivity 
of yS which has been shown at the end of Sec. IV CI that the 
quadratic form (l63l is negative definite if and only if the in- 
equality 



D K {0) =l+2n 



1*0 UL 



^CWdJ>0 (72) 



is satisfied. We hence conclude that the inequality d57| i is a 
necessary and sufficient condition for formal stability. Once 
the criterion (|57T > is obtained, we no longer have to seek an 
infinite number of Lagrangian multipliers to get the most re- 
fined formal stability criterion given in [22]. The formal sta- 
bility criterion (j57j is stronger than the condition that fo(J) is 
spectrally stable in the sense that the equality in (l24l > is not 
allowed. 



VI. COMPARISON WITH THE CANONICAL FORMAL 
STABILITY 

Let us compare the formal stability criterion ((57}, I[fo] = 
D x (0) > 0, with the canonical formal stability criterion given 



in 122H . We start with a brief review of the canonical formal 
stability. 



A. The canonical formal stability 



Claim 5 ( Il22ll ) A solution fo to the optimization problem ( 1431 ) 
is called canonically formally stable against any perturba- 
tion 6 e f whose direction is parallel to the order parameter 
Mq — (Mo,0) T , if and only if the second order variation of the 
functional T — S - /3S - aN at fo, 6 2< F[fo], subject to the 
normalization condition is negative definite, i.e., 



8 2 Tm[5J,5 e f]<Q, 



for all 6 e f + satisfying 



6 e f(q,p) dqdp = 0. 



(73) 



(74) 



In particular, for the HMF model, the spatially inhomoge- 
neous solution fc>(q,p) is canonically formally stable if and 
only if 



dq cos 2 q -—^-{q,p)dp- 

n J-oc P dp 



r ridf, 

dq cos q -—(q,p)dp 

J-n J-oo P dp 

f dq f -^p-(q,p)dp 

J-n J-oc P dp 



> 0. 



(75) 



Satisfying the inequality d75l l is sufficient but not necessary 
for the formal stability. We will show the existence of station- 
ary solutions fo which are not canonically formally stable, but 
formally stable in the most refined sense. 



B. Example: Family of distributions having metastable 
states 

In this subsection, we prove the following proposition: 
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Proposition 6 Let D be a subset of W. Assume that a fam- 
ily of smooth stationary solutions X — {fo(q, p\ Mq, A) \ A e 
D), which are parametrized with the order parameter 
Mq — M x [fo] and a set of macroscopic quantities A — 
(A\,A2,--- ,A„) e D, such that there exists f^(q,p) — 

f (q,p;M*,A h ) e X satisfying I [f^] = and M[f$] > 0. 
Moreover, assume that both I~[/o](Mo, A) and Ic[fa](Mo, A) 
depend on Mo and A continuously. Then, there are stationary 
solutions fij 6 X which do not satisfy the canonical formal 
stability criterion, Ic[fo](Mo, A) > (I75l l, but do satisfy the 
formal stability criterion, J[/o](M , A) = D x (0) > 07] ). 

Remark. If the system has a first order phase transition and 
a two-phase coexistence region in a parameter space (Mo, A), 
then we can take a family X of stationary solutions satisfy- 
ing assumptions in Prop. [6] An example of such a family X 
is known in Lynden-BelFs distributions (or Fermi-Dirac type 



distributions) l39ll . Within the Lynden-Bell's statistical me- 
chanics with two-valued water-bag initial conditions, single- 
body distributions are parametrized with the order parameter 
in stationary states Mo, the energy U, and the parameter Mi 
describing to what extent particles spread on the p-space be- 
fore violent relaxation occurs. In this case, one has n = 2 
and (Ai,A 2 ) = (U,Mi) lE6T - l28ll . A schematic picture of the 
phase diagram (Mo, U, M{) is exhibited in Fig. Q] On the three 
dimensional parameter space, one can observe a first order 
phase transition, a tricritical point, and a two-phase coexis- 
tence region. 



We will omit the parameters (Mo, A) from the description of 
fo, I[fo] and Xc[/o] as long as no confusion arises. To prove 
the proposition, we first rewrite the third term of the right- 
hand side of d75l l in terms of the angle-action coordinates, 



dqcosq I -—(q,p) dp) 

J-co P op Jr. Ui 



The difference between I[f)} and -Tct/o] is calculated as 



I[f ] - Idfol = -2n 



I 



&-C°(T) dJ 
Q(7) { ' 



r r°° i df r 

dq -—(q,p)dp 

J-K J-OO P OP J L 



Q(J) 



dJ 



Q(7) 



C°(7) 2 dJ + In 



(If—)" 



Q(7) 



Jl £!(/') Jl 



C°(J) 2 P(J) dJ 



(I 



C"(J)P(J) dJ 



2 



(76) 



(77) 



where P(J) is defined to be 



P(J) = 



1 %(J) 



Q.(J>) 

We note that the inequality, 



W) dJI W) 



> o. 



j C°(J) 2 P(J) <U-l§ C°(J)P(J)dJ\ 
is satisfied for any ft). In fact, on account of 
J P(J) dJ = 1, 



(78) 



(79) 



(80) 



we obtain the equation, 

j C°(J) 2 P(J) dJ-^J C°(J)P(J) dJ 



j C°(J)- j C°(f 



)P( J') dJ' 



P(J) dJ, 



(81) 



which implies Eq. (1791 . If the equality holds in d79l ), Eq. ( |8TT i 
results in 



cV) = JT 



C°(J')P(J') df = Constant, V/. 



(82) 



However, this equality cannot be realized for any smooth spa- 
tially inhomogeneous solution, so that Eq. d79l should be 

j C°(J) 2 P{J)dJ -|J~ C°(f)P(J)djj >0. (83) 
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M 1 




u c u px u b u 

FIG. 1 : Schematic picture of the phase diagram on (Mo, U) for some 
fixed M[ (2^1 . The solid curve represents the stable or metastable 
states which are realized as the local maximum points of the entropy. 
The broken curve represents the unstable states which are realized 
as the local minimum points of the entropy. These two curves meet 
at (Mg, U b ). A region between l/ c and U b is called the two-phase 
coexistence region, and the first order phase transition occurs at t/ pt . 



Equation d77l ) with y(J) < and this inequality are put to- 
gether to provide 

Ilfo] > IdM (84) 

for any smooth spatially inhomogeneous stationary solution 
fo- This implies the known inclusion relation J22I1 

{canonically formally stable states) 

n (85) 
[formally stable states). 

We show that there is a solution which is formally stable but 
not canonically formally stable. From the assumption in Prop. 

m 

i"[/o]=0. (86) 

If one could decide the formal stability of a stationary solution 
correctly by using the canonical formal stability criterion (|75T l 
near the stationary solution _/?, the equation 

Ic [fo] = (87) 

would be satisfied as well, since Jc[/o] depends on the param- 
eters continuously. However, we have proved the inequality 
d84l l, so that ( f86b and ( |87| i do not hold simultaneously. Then 
the inequality 

I c [fo] < I [fo] - (88) 

should be satisfied. From (l84l i and ( l88l , it follows that there 
exists fo such that 

JcLfo]<0, J[/ ]>0. (89) 

This implies that there is a solution which is formally stable, 
but not canonically formally stable. 



VII. SUMMARY AND DISCUSSION 

We have worked out the spectral and formal stability cri- 
teria for spatially inhomogeneous stationary solutions to the 
Vlasov equation for the HMF model. These criteria are stated 
in the form of necessary and sufficient conditions (see Props. [2] 
and|U). We stress that the assumptions for deriving the spectral 
stability criterion are satisfied by solutions to the optimization 
problem (l43l l. Our criterion avoids the problem of finding an 
infinite number of Lagrangian multipliers which are required 
in the previously obtained criterion ||22T| . We note that the 
formal stability criterion in Prop. |4]is stated in the form mod- 
ified from the original one in 111611 . since the perturbation 5 f 
perpendicular to the order parameter Mo with M y [dof] £ 
brings about the neutral formal stability, and since the set of 
neutrally formally stable solutions is defined so as not to be 
included in the set of formally stable ones by 1 1611 . 

We have shown that stability of some solutions in the family 
of stationary solutions having two-phase coexistence region 
in the phase diagram cannot be judged correctly by using the 
canonical formal stability criterion (see Prop. |6). A family of 
the Lynden-Bell's distributions is a family to which Prop. |6]is 
applied. 

So far we have analyzed stability criteria for the HMF 
model without external fields. The present methods can be 
applied for the HMF model with non-zero external field, if 
the Hamiltonian takes the form 

N p2 j N N 

Hn = Tj~2 + 22V 2 t 1 ~ cos{qi ~ qj) ) ~ h Tj cos q> - 

/=1 ij=l i=\ 

(90) 

All we have to do is to modify the single-body energy (fTSl 
by adding to the potential -Mo cos q the term —h cos q coming 
from external field. Then, we can make a similar discussion by 
using the angle-action coordinates. In this case, the rotational 
symmetry is broken, so that Z) v (0) + 0. Hence, the spectral 
and the formal stability criteria become 

DM > 0, D y (0) > 0, (91) 

and 

D x (0) > 0, D y (0) > 0, (92) 

respectively, and further the value of D V (Q) is computed as 
D y (0) = h/ {Mo + h) by using the same procedure as in ( |40l . 
In this case, the definition of formal stability is the same as 
one defined in 1161, so that we can refer to the linear sta- 
bility condition. Equation. ( |9TT i is a necessary condition for 
the linear stability of the spatially inhomogeneous solution, 
and (l92i l is a sufficient condition of it. In fact, linearly stable 
states are spectrally stable states, and formally stable states 
are linearly stable states (see lfl6ll for the proof). This discus- 
sion breaks down for the spatially inhomogeneous states in the 
HMF model without external field. 

Our procedure to look into the formal stability of the HMF 
model may be formally generalized to other models by us- 
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ing the biorthogonal functions and the Kalnajs' matrix form, 
which have been used in the astrophysics IS QJ, |4(J] ■ How- 
ever, there are difficulties in extending our result for the HMF 
model to that for general models. For instance, finding an 
appropriate biorthogonal system and analyzing the Kalnajs' 
matrix form are hard tasks. In fact, the dispersion function is 
not a complex-valued function but a linear operator or a ma- 
trix. Hence, the formal stability criterion should be described 
in the form of positive definiteness of matrices or linear oper- 
ators. 
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Appendix A: Definition of the neutral stability 

The neutral spectral stability is defined in terms of eigenval- 
ues with vanishing real parts in Sec. UD However, the neutral 
spectral stability is originally defined in terms of spectra, not 
eigenvalues only, with vanishing real parts HH . The reason 
why we modify the definition of neutral stability is that the 
linear operator £ in © has always continuous spectrum on 
the imaginary axis, and this does not bring about spectral in- 
stability. 



Appendix B: Eigenvalues of the linearized Vlasov operator 
and roots of the dispersion relation 

We review the relation between eigenvalues of the lin- 
earized Vlaso y op erator (|9) and roots of the dispersion rela- 
tion after J37ll4lll42ll . We do not deal with continuous spec- 
tra, embedded eigenvalues, or Landau poles in this appendix, 
since they do not set off the spectral instability. 



1. Spatially homogeneous state case 

Let fo(p) be a spatially homogeneous, even, unimodal, and 
smooth function. Let £ be the associated linearized Vlasov 
operator defined by ©. Then, the linearized Vlasov equation 
around fo(p) takes the form 



(Bl) 



We expand the both sides of ( IB 1 b into the Fourier series to find 
that the amplitude of the k-th Fourier mode f\,k(p> obeys one 



of the following equations 

fo, 



dfu 
dt 



k = 0, 



-ik 



pfu(p,t) 



<J-Oi 



h,k{p',t)dp'f'{p) 



-ikpf\,k(p,i), 



\k\ > 2. 



(B2) 

For \k\ > 2, there is no growth or damping mode. For \k\ = 1, 
if A is an eigenvalue of the linearized Vlasov operator £, the 
associated eigenfunction can be written as f\,k{p)e A ', and we 
get the equation for fi,k(p) 



fuip) 



f 

•J — o* 



f\,k(p') dp'. 



p - Wk . 

Integrating this equation over the whole R results in 

fo(P) 



1 + 



•J —a 



p - iA/k 



dp 



fhk(p') d P' 

oo 

which is rewritten as 

Xco 
fi,k(p') dp' = 
CO 

where A is defined to be 

fo(P) 



= 0, 



A(cj) = 1 + 



*_/ — < 



dp, 



(B3) 



(B4) 



(B5) 



(B6) 



and is called the spectral function defined on C \ R II37I1 . In 
view of ( TTZl i, we find that A(w) = D(a>) on the upper half de- 
plane. Here we note that the relation between A(w) and D(u>) 
for u € C \ R iH is given by 



I A(oj), Imw > 0, 

! A(oi) + 2/7r/ '(w), Imcj < 0. 



If the factor including /i a in ( IB4b vanishes, i.e., if 
Ak(p') dp' = 0, 



f 



(B7) 



(B8) 



then f\j(p) vanishes owing to (IB3I ). and thereby it has no con- 
cern with stability. We are then allowed to assume that the 
left-hand side of (IB8b do not vanish. It then follows from (lB51 l 
that if A is an eigenvalue of the linearized Vlasov operator £, 
the equation A(iA/k) = should be satisfied for k — 1 or for 
k — - 1 . It is to be remarked that the assumptions imposed on 
/o in Prop. [TJgive rise to the relation, 



A(oj) = A(-u>) = A(u>y = A(-cj*y 



(B9) 



This implies that if a> with Imw > is a root of the disper- 
sion relation (fT2l . then the linearized Vlasov operator £ has 
eigenvalues io), —id), -iof, and iu>*. Therefore, if £ has an 
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eigenvalue, £, has inevitably an unstable eigenvalue, so that 
the solution fo should be unstable. 



2. Spatially inhomogeneous state case 

So far we have analyzed the stability of spatially homoge- 
nous states. The procedure can be applied to spatially inho- 
mogeneous states l32ll . Let us rewrite the Poisson bracket as 



da db da db 
~ dld0 ~ deal 



(BIO) 



in terms of the angle-action coordinates. The linearized 
Vlasov equation can be written also in terms of the angle- 
action coordinates as follows, 



(BID 



where Sl(J) = dS(J)/dJ. We omit to put the tilde over fa 
and f\ to specify that the arguments of these functions are the 
angle-action variables, in this section. We expand the func- 
tions f {9, J, t), cos q(9, J), and sin q{6, J) into the Fourier se- 
ries, 



fx(e,j,t) = Yjf^t)e h 

keZ 

cos ? (6U) = ^CV)*?* 6 , 

keZ 

sin 4(0, /) = ^V(/)<?' le , 



(B12) 
(B13) 
(B14) 



keZ 



respectively. By using dB12b . (IB 131 ), and ( IB 14b . the potential 
term T't/i ] in jB lib is rewritten as 

- r V[f](q(0,J)) 

= jj cos(q(6,J)-q'(6',J'))fi(6',J',t)d0'dJ' 



2nY J C"'(J)e ime J] f C k {J'yf\ k {J',t)df 

meZ keZ ^ L 

+ In £ S"V)e ime J] f S k {J'Tfx, k (J\ t) df. 

™c*w fez J L 



(B15) 



Then, the m-th Fourier mode /i m is shown to satisfy the equa- 
tion, 



df. 



dt 

- 2nimC m {J)f 



imQ.(J)f hm (J,t) 

« v) 2 f c k (j'rkk(j',t)dj' (B16) 

keZ • Jl 

-2mmS m (J)f^J)Y^ f S k {J'Tf,k(J\t)dJ'. 

keZ ^ L 

Let fH6, J, t) = 2mez f\ ' W f)e' mB be an eigenfunction asso- 
ciated with an eigenvalue A of i.e., (/{' m ) £Z be the eigen- 



vector associated with the eigenvalue A. Setting 
and substituting it into dB 16b . we get 



(B17) 



mf'AJ) 
2n . C m (J) 



2n 



mQ.(J) - iA 

'«/o (■/) 
' mQ.{J) ■ 



keZ ^ L 



c k (jyfx A k (j')dj' 



ttS"V)2 f S k (J'Tft,k(J')dJ'. 

1 keZ ^ L 



(B18) 



Multiplying C m (J)* or S "'(/)* to both sides of dB~T8l l, sum- 
ming up over m e Z, and using the fact l32tl 



2n 



Si: 



mf^(J) 



toQ(7) - iA 
we obtain the equations 

m/ '(7) 



c m (jys"'(j) dj = 0, 



(B19) 



1 +2tt 



\c m (j)r dj 



mQ.(J) - iA 

[ c k {jyfl k (j') df = 0, 



(B20) 



keZ. 



and 



1 +2n 



\S"'(J)\ 2 dJ 



mQ(J) - iA 



keZ OL 



(B21) 



s\j'rfuj')dr =0. 



A necessary condition for the existence of the non-zero eigen- 
function corresponding to the eigenvalue A is that at least one 
of the following two equations is satisfied; 



A x (iA) =\+2n 



A y (iA) = l+ 2n 



\C m (J)\ 2 dJ = 0, 



^Lma(J)-iA 
mfo(J) 



(B22) 



mfi(J) - iA 



\S m (J)\ 2 dJ = 0. 



When Imw > 0, the spectral functions A x (a>) and A v (w) de- 
fined in dB22b coincide with the dispersion functions D x (oj) 



and D Y (u>) defined in 



and 



respectively. As in the 



homogeneous state case, both A t (a>) and A v (w) satisfy the re- 
lation (HU), since \C"\J)\ = \C-"'(J)\ and \S m (J)\ = \S-"'(J)\ 
are satisfied for all m e Z. It turns out that if a> with Imw > 
is a root of the dispersion relation D x (a>) = or D y (a>) = 0, 
the linearized Vlasov operator has eigenvalues, ia>, -ia>, —icf, 
and iaf . We hence conclude that if £ has an eigenvalue, £, has 
inevitably an unstable eigenvalue, so that the stationary solu- 
tion f){J) should be unstable. 
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